Methods for automatically evaluating answers to complex questions

Automatically Evaluating Answers to Definition Questions

Following recent developments in the automatic evaluation of machine translation and document summarization, we present a similar approach, implemented in a measure called POURPRE, for automatically evaluating answers to definition questions. Until now, the only way to assess the correctness of answers to such questions involves manual determination of whether an information nugget appears in a...

Evaluating Answers to Definition Questions

This paper describes an initial evaluation of systems that answer questions seeking definitions. The results suggest that humans agree sufficiently as to what the basic concepts that should be included in the definition of a particular subject are to permit the computation of concept recall. Computing concept precision is more problematic, however. Using the length in characters of a definition...

Finding Answers to Complex Questions

Evaluating EFL Learners’ Philosophical Mentality through their Answers to Philosophical Questions: Using Smith’s Framework

Given the role philosophical mentality can fulfill in bringing individuals the essential skills of wisdom and well thinking, the present paper, by applying Smith’s (2007) theoretical framework, strived to explore the extent philosophic-mindedness exists among the participants. Considering the fact that, a philosophic mind begets philosophical answers, the participants’ philosophical thi...

Contemporary methods for evaluating complex project proposals

The ability to evaluate project proposals, assessing future success, and organizational value is critical to overall business performance for most enterprises. Yet, predicting project success is difficult and often unreliable. A four-year field study shows that the effectiveness of available methods for evaluating and selecting large, complex project depends on the specific project type, org...